Limit Behaviour of Sequential Empirical Measure Processes 
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In this paper we obtain some uniform laws of large numbers and functional central limit theorems for 
sequential empirical measure processes indexed by classes of product functions satisfying appropriate 
Vapnik-Cervonenkis properties. 
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1 Introduction 

Let (X n ) n>1 be a sequence of i.i.d. random variables of law is, denned on a probability space (Q,,A, P) 
and taking values in some measurable space (U,U). Let Q be a class of measurable functions 

q : ([0,1] xU,B( [0, 1]) ® U) -» (JH, B (9*)) , 



£> ' where #([0,1]) and B (JR) denote the class of Borel sets of [0,1] and £H, respectively. The stochastic 



process 



j n 1 n 

- -^Q^/n^i) = -^2 S (i/n,Xi) (<?), 9^2) (1) 



n ^ — ' n 

i=l i=l 



is called t/ie sequential empirical measure process (s.e.m.p.) indexed by Q. 

It is known that any symmetric statistic can be seen as a functional of the classical empirical measure. 
The fact that the sequential empirical measure 

1 n 

8=1 

enables to reconstruct the whole sequence X±, X n (rather than the sample up to a permutation) makes 
of P„ a very flexible tool to represent complex and highly non-symmetric statistics. One can, for instance 
think of two-sample sequential rank statistics, ^-statistics or fractional ARIMA processes as treated in 
Barbe and Broniatowski [1997] , [1998a] and [19986]. In these references, sequential empirical measure 
representations allowed to obtain functional large deviation principles for classes of complex statistics 
as the ones evoked. Weak convergence in the case in which Q = {l [0)t] • / : < t < 1, / e J 7 } , where 
J 7 is a Donsker class, has been treated in van der Vaart and Wellner [1996] . In that case, it was found 
that weak convergence occured in £°° ([0, 1] X J-) , the limiting process being the standard Kiefer-Muller 
process indexed by [0, 1] x T . 

The aim of this paper is to obtain uniform laws of large numbers (U.L.L.N's) and functional central limit 
theorems (F.C.L.T's) for sequential empirical measure processes indexed by classes of product functions 
satisfying certain properties. Our results generalize those in van der Vaart and Wellner [1996] and allow 
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to obtain uniform results for classes of non-symmetric statistics of independent random variables whose 
laws depend non linearly on time. More precisely, let TL C D^ 0,1 ! and Q C SR U be two classes of functions. 
Define the class 

^ 4 n • g 4 {/ = h 9 : h g n, g g g} . 

In the sequel, we will consider combinations of the following three conditions: 

(HI) TL is a uniformly bounded Vapnik-Cervonenkis graph class (V.C.G.C.) of almost everywhere con- 
tinuous functions; 

(H2) g is a V.C.G.C. with envelope G £ L\ (u) such that, for all x £ U, G (x) < +00. 

(H3) g is a V.C.G.C. with envelope G E L2 {v) such that, for all x E U, G (x) < +00. 

For an extensive account on Vapnik-Cervonenkis Theory, the reader is referred to Chapter 4 of Dudley 
[1999] . To avoid any measurability issues, all function classes considered in this paper will be assumed 
to be permissible in the sense of Appendix C of Pollard [1984] . We will now introduce some notation 
to be used throughout the paper. First note that, since v is a finite measure, condition (H3) implies 
condition (H2) but the converse fails in general. We will write E ir (vG, J-VC) if conditions (HI) 
and (H2) are verified and if J- n is jointly a V.C.G.C. (i.e. as a function of two variables). We will write 
T-x E 7r (vG 2 , J-VC^j if conditions (HI) and (H3) are verified and if J- w (as a function of two variables) is a 
V.C.G.C. Finally, we will write J- n G vr (UB, M-VC) if condition (HI) is verified and condition (H2) (or, 
equivalently, condition (H3)) is verified with G a constant function, i.e. g is uniformly bounded as well. 
In this respect, it is to be noticed that V.C. properties of two function classes are not inherited by the 
class of their pointwise products. Similarly, a V.C.G.C. of functions of two variables does not transmit 
its V.C. properties to the two classes of one variable obtained by marginalization or projection. For more 
details, the reader is referred to Dudley [1999] and Stelgle ad Yukich [1989] . In the sequel, whenever a 
uniformly bounded class of function is considered, it will be tacitly assumed, without loss of generality, 
that the envelope is identically equal to 1. 

Since condition (HI) ensures Riemann integrability of every h G TL (see Ash [1972] , Theorem 1.7.1), we 
have that, for all h ETC, 

lim X n (h)= [ h(s)\ n (ds) = -y^h(i/n)= [ h (s) A (ds) = X(h) , 
n ^+°° J [0,1] n ~[ J [0,1] 

where 

n 

A n — rT 1 6i/ n , 
1=1 

will be referred to as the uniform discrete measure on [0, 1] and where A denotes the trace of Lebsegue 
measure on [0, 1] . 

The paper is organized as follows: in Section [2] the main results uniform laws of large numbers are 
presented and discussed. The same is done in Section [3] for functional central limit theorems. All the 
proofs are contained in the last section. 



2 Uniform laws of large numbers 

We start with some classical results. Let (T, £) be a measurable space and let T be a class of ^-measurable 
functions / : (T,£) — > (9i,B (9t)) . Let F be an ^-measurable envelope of T . Let {w n i) n>l x<i<i( n ) > with 
lim n i (n) = +00, be a triangular array of random probability measures on (T,£) , and let (£ni) n >i i<i<j( n ) 
be a triangular array of real- valued random variables defined on (T,£). The ^"-indexed stochastic process 

Sn(f)= £ W nl (f)U, (2) 
i<i(n) 
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is called random measure process. General random measure processes have been introduced and studied 
in Gaenssler [1992, 1993] , Gaenssler and Ziegler [19946] , Gaenssler, Rost and Ziegler [1998] and Ziegler 
[1997] . This treatment allowed to obtain uniform laws of large numbers and functional central limit theo- 
rems for smoothed empirical processes, partial-sum processes with fixed and random locations, empirical 
versions of the non parametric regression function and empirical- type estimators of the intensity measure 
of spatial Poisson processes. 



To see that sequential empirical measure processes are special cases of random measure processes, it 

(i/n,Xi)- 



suffices to take T = [0, 1] x U, £ = B ([0, 1]) ®U, i (n) = n, £ n i = n 1 and w n i = 5u/ n ^x i )- In Gaenssler 



Rost and Ziegler [1998] , the following result is shown: 
Theorem 1 (Gaenssler, Rost and Ziegler 1998). Assume the following conditions hold: 
(i) There exists p > 1 such that, for all 5 > 0, 



lim E H W ni(Ff -\U\ P ■\8,+oo)(Wni(F)\U\)) =0; 



n— >+oo 

l<i<i(n) 



(ii) There exists 5± > such that 



sup ^ E (w ni (F) ■ |£ ni | • l [0)(5l ] (w ni (F) \ini\)) < +oo; 



n>l . ., , 

(Hi) For all r > 0, there exists 5 = 5 (r) such that the sequence 

jiV (rfi n s (F) , T , dfj^^j : n > 1 j , 
of random covering numbers is stochastically bounded, where the random measure fi n 5 is defined by 

VnS - ^ W ni ■ \£ni\ • 1[0,5] { w ni {F) , 
l<i<i(n) 

and the random pseudo-metric d^ 6 is defined on T by 

d< £} S (f>9)= ^ \ W ni(f)- Wni (g)\-\tni\- 1-10,8} (Wni(F)\£ni\), /, 9 € T. 
l<i<i(n) 

Then, the sequence {S n (/) : / G J 7 } , n > 1, of random measure processes as defined in H|j verifies 
the following version of the L p -uniform law of large numbers: 

sup \S n (J)-E(S n (f)) |^0. 

The reader is referred to Section \4. II for the definition of covering numbers. As a consequence of Theorem 
[H we have the following U. L.L.N, for ^-indexed sequential empirical measure processes 

Corollary 2 If J- n G vr (uG 1 , J-VC) , then 



sup |P„(/)- (A„<8) !/)(/) |^0. (3) 



If, moreover, the class 7i in the definition of J- n is such that 



sup|A n (/t)-A(/i)H0, (4) 

h&H 
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then 



sup |P„(/)-(A®i/)(/)|^0. 



(5) 



(6) 



(7) 



On the other hand, if G ir (UB,M-VC) , then, for all p > 1, 

sup |P n (/)- (A n &*/)(/) | ^0. 

If, moreover, condition ^ holds, then, for all p > 1, 

sup |Pn(/)-(A®i/)(/)|^0. 

Proof. If ^ G vr (US, M-VC) or ^ G ?r (i/G 1 , J-VC) , and taking / = then 

n 

E(F n (f)) = -J2h(i/n)u(g) 

i=l 

= X n (h) v (g) 
= (A n 

Now, let J 7 ^ £ ir (UB, M-VC) . Since F = 1 is an envelope of Jv, then conditions (i) and (ii) of Theorem 
[T] are easily verified. In particular, condition (i) holds for all p > 1. Moreover, Proposition [19] implies 
condition (iii) of Theorem [T] thus completing the proof of (|6|). To show that (J4j) implies 0, note that, for 
all p > 1, 



sup |P„(/)- (A ® !/)(/) I 



< 



sup |P n (/) - (A n ® I/) (/)| 



+ 



sup |(A n ® f) (/)- (A® 



^ A(n) + B(n), 

where ||-|| denotes the L p (v) norm. The term A (n) converges to by ([6]); as for the term B (n) , noting 
that G = 1 is an envelope of Q, 



B(n) < 



sup \v(g) | 

960 



sup I A„ (/i) ~ A (fo)| 
hew 



< 



sup I A n (h) - X(h)\ 

h&i 



Since we have set v (G) = 1, by convention. Covergence to of B (n) follows from The case J- w G 
ir {vG, J-VC) can be treated analogously. Conditions (i) and (ii) are verified immediately and condition 
(iii) follows from the fact that J- n is a V.C.G.C. ■ 

If Ti verifies (j3J), we will say that TL is uniformly Riemann-integrable. Here is an example of a uniformly 
Riemann-integrable class. 

Example 3 Let Tt (T, C, (3) , T,C,@ > 0, the class of all Holder functions of parameters C and such 
that \h(0)\ <T. In other words, for all x\,X2 G [0, 1] , 



\h (xi) — h (a?2)| < C \x\ — X2\^ ■ 
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First of all, note that H (T, C, (3) is uniformly bounded. In fact, for all h EH (T, C, j3) and all x G [0, 1] 

\h{x)\ < C\xf + T< C + T. 
To show uniform Riemann-integrability, define the sequence of functions 



h n {%) — 2_] h If »-i il ( x ) , n> 1. 

V n ' n J 

4 = 1 



Clearly, X n (h) = X(h n ) , so that 



\X n (h))-X(h)\ < f \h{x)-h n (x)\dx 
Jo 

n 



II: r. _ 

< ^2 " \h(x) -h(i/n)\ dx 



i=i 
C_ 

Uniform Riemann-integrability follows since 5 n = C /n@ dos not depend on h. 

Remark 4 Note that continuity is not necessary to achieve uniform Riemann-integrability. It suffices, 
in fact, to observe that the class 

W[o,l] = {l[o,t] :0<t < 1}, 

is uniformly Riemann-integrable. 

The remaining part of this section is devoted to the presentation of a U. L.L.N, in which convergence 
occurs almost-surely. Let B C B ([0, 1]) be the class of all regular Borel-sets. Recall that a Borel set B 
is called regular if (i) A (B) > and (ii) A (dB) = 0, where dB is the the boudary of B. By Lemma 2 in 
Dedecker [2001] , if B is a regular Borel set of [0, 1] , then 

lim X n (B) = X(B), (8) 

where X n and A denote, respectively, the discrete uniform measure and the trace of Lebesgue measure 
on [0, 1] . Let (X n ) n>1 be an i.i.d. sequence of random variables of law v defined on a probability space 
(Q,A,P) and taking values in some measurable space (U,U) . For all B £ B, define the B-empirical 
measure on (U,U) by 

v n,B = , ;1 rry 6x *> ( 9 ) 

card Bflji,... , UJ 7^ . 

with the convention that v n ^ = if Bn {-,..., 1} = 0. 

With P n = ra X^iLi fi(i/n,Xi) the sequential empirical measure, note that for B £ B and A G U, 

K{BxA) = ~ ^ * X .(A) 
ieBn{i...,l} 
= A n (B) i/ niB (A) , 

so that 

E(P n (BxA)) = X n (B)u(A). 

It turns out that the 5-empirical measure verifies a Glivenko-Cantelli-type result (see Lemma [2Tj) . This 
fact will be used later to prove the following version of the U. L.L.N, for J~b # ,w-indexed sequential empirical 
measure processes where J r s # ,w — {^-B^-w '■ B G B#, W G W} , and B# C B is a C.V.C. of regular Borel 
subsets of [0, 1] . 
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Theorem 5 Let the notations of this section prevail. If W CU is a V.C. C. and if B# is a V. C. C. of 
regular Borel sets of [0, 1] , then 

P\ lim sup sup |P„ (B x W) - \„ (B) u (W)\ = 0) = 1. (10) 
\"-H-°° BeB # W&W J 

If, moreover, B# is such that 

lim sup \X n {B)-X(B)\ = 0, (11) 



then 



n-*+oo BeB # 



P\ lim sup sup \¥ n (B x W) - \(B)v(W)\ = = 1. (12) 



We end this section with some comments and an open problem. First, in the following two examples, we 
present special cases of V.C.C.'s of regular Borel sets satisfying (|11|) , In the third example we present a 
class of regular Borel-sets that is not a V.C.C. and for which (jlip does not hold. 



Example 6 Fix j £ N and a vector t 2 j + \ = (to, t 2 j) £ [0, l] 2j+ , witht2k < ^2fc+i> f° r M k = 0, j — 1 
and t2fc-i < ^2fc> / or M k = 1, j. We to// adopt the following convention: for j = 0, t2j+i = ti = to = 
t £ (0, 1] . Let ^2j+i be the set of all such vectors. For all t 2 j + \ £ %2j+l, let B t2j+1 G i3 ([0, 1]) 6e defined 
by 

B t 2j+1 = (0,to) U (ti,t 2 ) U • • -U (t 2 j-i,%) , 
where (a, /?) denotes an open, closed or semi-open interval with extremes a < (3. Define the class 

B(2j + l)±{B t2j+1 :t 2j+1 eZ 2j+1 }. 

In particular, B (1) = {(0, i) : < i < 1} . can 6e shown that B (2j + 1) is a C. C. o/ dimension 2j + 1 
(see Dudley [1999] , Problem A.ll). On the other hand, for all B t2j+1 £ B (2j + 1) , there exists a vector 
^2j+i £ ^2j+i such that 

\ (T3 \ L n *oJ . s^f[nt 2 k\ [nt 2 k-i 

K{^t 2j+1 ) = — — + 2_^ 



n f — ' \ n n 

k=l 



and 



It is easily seen that 



k=i 



A (B t2j+1 ) = t + ^2 (t 2k - t 2 k-i) ■ 

2 (2j + 1) 



| A n {B t2j+1 ) - A (-Btjy+i) I < 



n 



Since 5 n = 2 ^ 2 ^ +1 ' ) converges to and does not depend on the vector t 2 j+i, we have that, for all j > 1, 

lim sup | A n {B t2j+1 ) - A (B t2 ) | = 0. 

n B t2j+1 eB(2j+l) 

Example 7 Fix j £ N + and a vector t 2 j = (ti,...,t 2 j) £ [0, 1] 2,J with t 2 f. < t 2 k+i for all k = 1, — 1 and 
t 2 k-\ < t 2 k for all k = 1, j. Let % 2 j be the set of all such vectors. For all t 2 j £ % 2 j, let B t2j £ B ([0,1]) 
be defined by 

B t2j = (h,t 2 ) U- • -U (t2j-i,hj), 
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where the notation (a, (3) is defined in the previous Example. Define the class 

B(2j)±{B t2j ;t 2j eT 2j }. 
Again, it can be shown that B (2j) is a V.C.C. of dimension 2j and 

sup |A n (B t2 .) - A (B t2j ) | < ^ -> (n +00) . 



n 



Here is a class of regular Borel sets, closely related to those treated in Examples [6] and for which (jlip 
does not hold 

Example 8 Define the class 

Boo = |J B (n) , 

n>l 

where B (n) is defined in Example^ or [7] according to whether n is odd or even, respectively. To see that 
[77]) does noi hold for Boo, consider the sequence (B n ) n>l of Borel sets defined by 









2 






/n- 1 


( 0, - - £„ 








U • 


• U 










n 






\ n 



1 -£n 



n > 1, 



where e n = n > 1. Clearly, for all n > 1, -B n € B (n) , X n (B n ) = and X(B n ) = 1 — 

Consegiteni/y ; 

lim |A n - A {B n )\ = lim (1 - ne n ) = 1. 

n— >+oo n— >+oo 

Finally, note that Boo is clearly not a V. C. C. 

Here is the statement of the announced open problem: 

Problem. Is it possible to establish a U. L.L.N, along the lines of Theorem [5] for sequential empirical 
measure processes indexed by the class 

?B*,W = {f = Ifllw = B G B\ W G W} , 

where WcW is a V.C.C. and where £>* is an arbitrary class of regular Borel sets (not necessarily a 
C.V.C.)? 

Clearly, if B* is not a V.C.C, Theorem [5] does not apply. Moreover, our techniques are not conclusive. 
In fact, rehearsing the proof in section B~2l one is confronted with studying the convergence of the double 
series 



n>lk=l ^ ' 



where D is a strictly positive natural number and c is a positive real number. Now, if c > log 2, 

S{D,c)<Y,n D (^) <+oo, 



n>l 

whereas, if c < log 2, 



n>l V J 
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3 Functional central limit theorems 



This section is devoted to obtaining functional central limit theorems for sequences of ^--indexed se- 
quential empirical measure processes, when E n^vG 2 , J-VC) and E tt (UB, M-VC) . Obtaining 
F.C.L.T's amounts essentially to proving two facts: (i) convergence of finite dimentional distributions of 
the sequence to those of a centered Gaussian process and (ii) asymptotic equicontinuity of the sequence 
of processes. We start by showing convergence of finite-dimensional laws. Note that this will be done 
for a much larger class than those mainly considered in this paper. The reason for this is to exhibit the 
limiting Gaussian process one needs to consider in view of possible generalizations of our results. Let Q 
be the class of all (B ([0, 1]) <8> £/)-measurable functions q E IRl ' 1 ]*^ such that the following two conditions 
hold: 

(a) for every q E Q, there exists a function g q E L 2 iy) such that, for all (s, x) E [0, 1] x U, 

\q(s,x)\ < g q (x) ; 

(b) for all q E Q and all x E U, the function 

s^q(s,x): [0,1] —* R, 

is A-almost everywhere continuous. 

Consider the sequence of Q-indexed s.e.m.p.'s {Z n (q) : q E Q} , n > 1, where, for each q E Q and n > 1, 
Z n (q) is defined by 

Z n (q)±^K(F n (q)-(K®v) (?)), 

the quantity P n (q) being defined in ([1]) and X n denoting the discrete uniform measure on [0,1]. Let 
{Z (q) : q E Q} be a centered Gaussian process whose covariance structure is given by 

Cov (Z (qi) , Z = / \v (qi ■ q 2 ) (s) - v ( gi ) (s) ■ v (q 2 ) (s)} A (da) , (13) 
J [0,1] 

where A is the trace of Lebesgue measure on [0, 1] , where 

v (?i • 92) (s) = / q 1 (s,x)q 2 (s,x)u(dx) , 
Ju 

and where 

^(<?p)( s )- / q P (s,x)u(dx) , p=l,2. 
JU 

Note that if q\ = l[o s ij < s < 1 and q 2 = l[o,x] < x < 1, then the covariance structure described in 
(|13|) defines that of the classical Kiefer process on [0, l] 2 . In the next section, we will prove the following 

Proposition 9 The finite dimensional laws of the sequence of Q-indexed s.e.m.p. 's {Z n (q) : q E Q} , 
n > 1, converge to those of the centered Gaussian process {Z (q) : q E Q} whose covariance structure is 
given by $13\). 

We will first use the Lindeberg central limit theorem to prove that, for all q E Q, the sequence of random 
variables Z n (q) , n > 1, converges in law to Z (q) . The proof of Proposition [9] will be then completed by an 
application of the Cramer- Wold device. In what follows, we analyze more closely the defining conditions 
of the class Q. First of all, we observe that for all q E Q, the function 

v{q 2 ) (s) = / q 2 (s, x) v (dx) , 
Ju 
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is Riemann-integrable. In fact, condition (b) implies that, for all 1 < p < +00, the function s 1— > q p (s, x) 
is A-almost everywhere continuous for all x £ U. This, in turn, implies the A-almost everywhere continuity 
of 

v(q p )(s)= [ q p {s,x)v{dx), 



u 

for all 1 < p < +00 and in particular for p = 2. Now, condition (a) implies the boundedness of v (g 2 ) : 
[0, 1] — ► R, since this conditions ensures the existence of a function g q : U — ► R such that, for all s E [0, 1] , 

g 2 (s, z) (dx) < / g\ (x) v (dx) = v (g 2 ) < +00. 
u Ju 

Riemann-integrability of v (g 2 ) (•) follows by Theorem 1.7.1 in Ash [1972] . This fact has an important 
consequence for our purposes. Namely 



-00 



lim (A n ® v) (q 2 ) = / q 2 (s, x) (A ® 1/) (ds, da;) = (A ® 1/) (g 2 ) , (14) 
'~~ L " ./[0,I]x(/ 



a condition without which applying Lindeberg central limit theorem would be impossible. Moreover, Q 
is a linear space. In other words, for all (01, ax) £ R^ and all (gi,...,gx) £ Q^, if = 1,2,..., the 
function gs — 2j=i a i°i ( s ' x ) * s an element of Q. In fact, it is immediately seen that gs verifies condition 
(b). As for condition (a), observe that, for all (s,x) S [0, 1] x U, 



K 

Y a i^ (s,x) 



K 

<M s ^| % (x)|, 



where Ms = maxi<j<^ \aj\ is a positive (finite) constant and where g qi , ■■■,g qic are elements L 2 (u) whose 
existence is guaranteed by condition (b). Cauchy-Scwartz inequality now gives 

K 

3=1 l<«^m<X 

proving that gs verifies condition (a). Once more, this is key to employing the Cramer- Wold device. 

Let us return to JF^-indexed s.e.m.p.'s with £ vr (vG 2 , J-VC) or T v £ 7r (?75, M-VC) . It is trivial 
to see that, in both cases, C Q. Now for all fx, fa £ = 7i ■ Q , write fx = hxgx and /a = h 2 g 2 , with 
/ii,/i2 £ H C D^ ' 1 ! and gx,92 £ G C to see that the covariance structure of the ^--indexed limiting 
centered Gaussian process {Z (/) : / £ JF,,-} is given by 

Co?; (Z (A) , Z (/ 2 )) = A (hxh 2 ) [u (gx92) - v (gx) v (g 2 )} • (15) 

In the next section we will prove weak convergence of the sequence of s.e.m.p.'s {Z n (/) : / G J-^} , n > 1, 
to a centered Gaussian process with uniformly bounded and uniformly continuous sample paths and 
covariance function given by (fToT) . both when G 7r (z^G 2 , J-VC) and G 7r (£FB, M-VC) . By "weak 
convergence" we mean in the sense of Hoffman- J0rgensen /^-convergence (see Hoffmann J0rgensen [1991]). 
Observe, in fact, that the sequence of processes Z„, n > 1, can be seen as a sequence of random quantities 
(i.e. not necessarily measurable) with sample paths in the pseudo-metric space (1°° (Jv) , IHI^r ) j where 
H'll^r denotes the sup norm defined by ||-||^r — sup^g^ |-| . Towards our aim, we need to show that 
there exists a version of the limiting Gaussian process with uniformly bounded and uniformly continuous 
sample paths, a fact for which one only needs that the sub-space (UB b {F w ,d),\\-\\p n ) of uniformly 
bounded and uniformly continuous functions (with respect to some metric d) to be a separable subset of 
(£°° (^v) , || -H^) • For this, it is suffices that {T^, d) be a totally bounded pseudometric space. That is 
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why, from now on, will be endowed with the totally bounded pseudometric (see the section [47X1 for the 
proof) 

d(fi,h) = d(h 1 g 1 ,h 2 g 2 ) = <4 (h x ,h 2 ) + d^ (g\,g 2 ) , 

(2) (2) 

where d x and d v denote, respectively, the L 2 (A) pseudometric on H and the L 2 (y) pseudo metric on 
Q. Once this result is at hand, we will need to prove asymptotic (d-)equicontinuity of the sequence Z n , 
n > 1. We will denote the fact that Z n converges weakly to a separable centres Gaussian process Z with 
uniformly bounded and uniformly continuous sample paths by writing, as in Ziegler [1997] , Z n — > Z in 

sep 

i°° (J'n, d) . In the next section we will prove the following results: 
Theorem 10 If H ■ Q = T v G vr (vG 2 , J-VC) and ifH is such that 



lim sup 



A n ((h - h 2 f) - A ((Zn - h 2 f) | = 0, (16) 



then 

Z n ^ Z in I 00 

sep 

Theorem 11 IfH ■ Q = T v G tt (UB,M-VC) and ifH verifies QQ), then 

Z n h Z inl°° (F^d). 

As will be seen in the next section, Theorem [10] is in fact a corollary of the findings in Section 4.2 of 
Ziegler [1997] . As for the proof of Theorem II 1\ we will use a maximal inequality stated in Theorem 3.1 
of the same reference. We end this section presenting two examples of classes H C SH^ 0,1 ] for which (|16f) 
holds. 

Example 12 It is easily seen that ifH is (1) uniformly Riemann-integrable, (2) such that 

H 2 = {h 2 :h£ H} 

is uniformly Riemann-interable and (3) such that for all h\,h 2 G TL, h = h\h 2 is an element ofTL, then 
condition t!6\) holds. 



Example 13 We show that the classTi (T,C,f3) defined in Example^ satisfies [Tb)) . Incidentally, observe 
that condition (3) of Example [7H does not hold for 7i (T, C, (3) . Now, for all hi, h 2 G H (T, C, j3) , define 
the two respective function sequences 



h 



,n(x) = y~]hi (i/n) ii (x) , n>l, 

i=i 



^l,n(aO = y^h 2 (i/n) n(x) , n > 1. 

i=i 

Then, for all n> 1, 

n 

(fri,n (») - fti.n (^)) = [^i - ^2 (V™)] Vi^i il 0*0 

V 71 ' n J 

i=l 

and 



(frl,n (k) - /ii, n (^)) 2 = y] [/il (i/n) - h 2 (i/n)] 2 l(i-x _n (x) . 
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It follows that 

1 n 

A„ {(hi - h 2 ) 2 ) = - ^2 [^1 (V n ) - h 2 (i/n)} 2 = A ((/ii, n (x) - hi >n (x)) 2 ) . 



n 

i=i 



Note that 
sup 



A ((hi - h 2 f - (hi tfl (x) - h 1>n (x)f) < 2 sup \\{h 2 n -h 2 )\ 

V ' heH(T,C,(3) 



+ 2 sup |A (h\ )n hi,n — h\h 2 ) 

hi,h 2 eH(T,C,P) 



Since, by Cauchy- Schwartz inequality and uniform boudedness ofH(T,C,/3) (see Example^), 
\\{hl-h 2 )\ < J A (hi) \((h n - h) 2 ) +^\ (/i 2 ) A ((h n - h) 2 ) 

< 2(C + T) ^\((h n -h) 2 ), 

and since, for all h £ H (T, C, (3) and all xi,x 2 £ [0, 1] , 

\h(xi) - h (x 2 )\ 2 < C 2 \xi - x 2 \ 213 , 
proceeding exactly as in Example^ one has 

A ((^-^) 2 )<^, 

so that 

lim sup I A (/i n — h 2 ) I = 0. 

™^+°° h£H(T,C,/3) 

Analogously, it is possible to show that 

\\(hi >n h 2 , n -hih 2 )\ < ^A (/i 2 n ) A ((h hn - hi) 2 ) + ^\ (h 2 ) A ((/i 2 , n - /i 2 ) 2 ) 

2C(C + T) 

thus proving 

lim sup |A (hi jn h 2jn — hih 2 )\ = 0. 
We have shown that U6\) holds for H (T, C, (3) . 

4 Proofs 

4.1 Ancillary lemmas 

Here are the definition of covering numbers of a pseudo-metric space and the statements of four elementary 
facts regarding such quantities. 

Definition 14 Let (M, d) be a pseudo-metric space. Given u > 0, a set 

M (n) = {m 1 ,...,m n } C M 

is called a u-net in (M,d) if, for all m 6 M, there exists rrii £ {mi, ...,m n } such that d(m,mi) < u. The 
number 

N (u, M, d) = inf jn > 1 : there exists a u-net M (n) in (M, d)| , 
is called u-covering number of (M, d) . 
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Lemma 15 Let (M, d) be a metric space and let M' C M. Then, for all u > 0, 

N(u,M',d) <N(u,M,d). 

Lemma 16 Let d and d' be two pseudo-metrics on some set M and suppose that, for all mi,m2 £ M, 
d (mi , 1712) < d' (mi , 7712) . Then, for all u > 0, 

N (u, M, d)< N (u, M, d!) . 

Lemma 17 Let (Mi,di) and (M2,d2) be two psudo-metric spaces. Define the pseudo metric space (M,d) 
by M = Mi x M 2 and d = di + d 2 . Then, for all u > and all t £ (0, 1) , 

N(u,M,d) < N(tu,Mi,di)N((l-t)u,M2,d 2 ). 

Lemma 18 Let (M,d) and (M',d!) be two pseudo-metric spaces. Let b : M — » M be a bijection such 
that for all m\, m'2 £ M', 

d'(m' 1 ,m' 2 )=d(b- 1 (m' 1 ),b- 1 (m' 2 )). 

Then, for all u > 0, 

N(u,M,d) =N(u,M',d') . 

The remaining part of this section is devoted to the proof of some entropy properties of classes J- n £ 
7r (UB, M-VC) and J f G tt (vG 2 , J-VC) . We start by proving stochastic boudedness of some random 
covering numbers when £ ir (UB, M-VC). This fact is used to show that ^--indexed s.e.m.p. verifies 
an Lp-uniform law of large numbers (see Corollary [2]) . Let /, /i,/2 £ J~n £ it (UB, M-VC) and write 
/ = hg, fi = hiQi, % = 1,2, for some h, hi, h% EH and g,gi,g2 £ Q- Define the quantities 



(l/l) = ~X>(*A0 



n . 

i=i 



and 

v(l) 



4:(/uf2) = ii/i-/ 2 ii Pn 
1 n 

~y~]\hi (i/n)gi (Xi) - h 2 (i/n)g 2 (Xi 



n . 

1=1 



Proposition 19 If J- n £ vr (UB,M-VC) , then, for all r > 0, there exists a constant C, depending only 
on t and the V.C. dimensions of classes 7i and Q, such that, for all oj £ O and all n > 1, 

sup sup N (t, J- w , 4^ ) < C 



wGQ n>l 

Proof. Let v n and A ra denote, respectively, the (classical) empirical measure defined by v n = n _1 X^ILi ^ 
and the discrete uniform measure on [0, 1] defined by X n = n^ 1 J2i=i 3{i/n} - F° r an /1 = ^l<7l an d /2 = ^252 
in £ 7T (t/-B, M-VC) , by uniform boudedness of classes H and £/, it is immediately seen that, for all 
co £ Q and all n > 1, 

4? /2) < dg? (5i,52) + d£ (/n, M , 

where d$ (51,52) — v n (\gi — 52 1) and 4^ (^li ^2) — A n (|/ii — /12I) • By Lemma [TBI we have that, for all 
r > 0, all a; £ SI and all n > 1, 

N (r, ^, 42) < AT (r, ^, d« + 42) • (17) 
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Equip H x Q with the equivalence relation ~ defined by 

(h,g) ~ (ti,g) O hg = tig', 

and let 7i x Q be the subset of H x Q obtained by choosing exactly one element from each equivalence 
class. Now the application b : TC x Q —* : (h, g) i— > /ig is a bijection so that, applying Lemma [T8l then 
Lemma [151 one obtains that, for all r > 0, all u G SI and all n > 1, 

JV (r, ^, d£ + d£>) = JV (r, 70^7, d&> + < JV (r, H x 0, dg? + d£) (18) 

Lemma [T7] with t = 1/2 now gives for all u; G and all n > 1, 

JV (r,W x g, + d«) < JV (r/2,W,d£) JV (r/2,g,d^) . (19) 



Since 7i is a V.C.G.C. and A n is a finite measure for all n > 1, for all e > 0, there exists a constant 
Ci depending only on e and on the V.C. dimension of H such that, for all n > 1, JV ^e,?i, < Ci. 
Analogously, since is a V.C.G.C. and f n is a finite measure for all uj G $7 and all n > 1, for ah e > 0, 
there exists a constant C2 depending only on e and the V.C. dimension of Q such that, for all u G SI and 
n > 1, JV (e,^,^) < C 2 . Take r = 2e. Combining inequalities (JTTD, (JTSD and (USD gives 

sup sup JV (r,.F ir ,<4 , ) < C1C2. 

The proof is complete with C = C\C 2 . ■ 

We now turn to the case J- w G vr (1/G 2 , J-yC) . First of all, we show can be made into a totally 

(2) (2) 

bouded pseudo-metric space. Let d x and d y be the L 2 (A) and the L 2 (u) pseudo-metrics on H and Q, 
respectively. Endow T n with the pseudo-metric 

d (h, f 2 ) = (h,h 2 ) + d^ ( 9l ,g 2 ) , (20) 

where f\ = h\g\ and f 2 = h 2 g 2 are any two elements of J- n . It suffices to rehearse the arguments in the 
proof of Proposition [19] to show that, for all e > 0, 

N (e^^d) < N (e/2,H,d ( f ) ) N (e/2,G,di 2 A < +00, 



and, therefore, that d) is totally bounded. This fact and the one presented in the following proposition 
are key to proving uniform central limit theorems for sequences of .^-indexed sequential empirical measure 
processes. 

Proposition 20 Let {X n ) n>l be a sequence of i.i.d. random variables defined on a probability space 
(Q,A,P) and taking values in some measurable space (U,U). Let v be the law of Xi and let be a class 
of product functions f = hg, where h G 7i C y^ ' 1 ^ and g G Q C V\ u . Suppose H and Q verify conditions 
(HI) and (H3), respectively. Let ||-||(x n ®w) ^ e ^ e semi-norm on such that 



l(A„^) = (An^)(.f 2 ), /G^, 

where X n is the discrete uniform measure on [0, 1] , and let d^ x ^ % be the pseudo-metric on J- n defined by 

d f\ n ®v) (h'h) - ll/l - M\(\ n ®v) , /l,/2 e T n . 
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If 



then 



lim sup 



\ n (hi - h 2 ) 2 -\(hi- h 2 y 



(21) 



limlimsup sup dg ' (/ a , / 2 ) = 0, 

where T% = {/i, /2 € J T : (J (/i, /2) < a} and d is defined in l(2ty) . 
Proof. Take /i,<?i E with /i = h\g\ and / 2 = h 2 g 2 . Then 



< ll^lll(An^) 11^1 " 92\\ { X n ® u ) + WtoWy^Vv) ~ h2\\ {Xn9u) 

= yj K {h\) v fa - 52 ) 2 ) + Jv (gf) X n fa - h 2 ) 2 ) 

< u(G 2 ) [d^(g 1 ,g 2 )+d^(h 1 ,h 2 )\ , 

where G is the envelope of Q. Then, assuming, without loss of generality, that v (G 2 ) = 1, we have 



where 



and 



Now, 



SU P 4a„8i/1 (Zi'/z) ^ SU P 4 2) (5i,52)+ sup dV(hi,h 2 ) 

(2) 

< a + sup d\ (hi, h 2 ) , 



Qu= {51,52 Ga:4 2) (51,52) < a}, 
— h 2 eH : df (hi, h 2 ) < a} . 



sup dy^ (hi,h 2 ) < sup d^ 1 (hi,h 2 ) 



+ sup 



A n (hi - h 2 ) 2 - A (hi - /l 2 ) 2 



< a + sup 



A n (hi - h 2 ) 2 - A (hi - h 2 ) 2 



Taking limits, one has 



so that 



(2) 

lim sup d^ (hi, h 2 ) < a, 



n ^ +00 /i,/2e^ 
Taking limits for a J. completes the proof. ■ 



lim sup df^ v) (h,f 2 ) < 2a 
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4.2 Proof of Theorem [S 

Here is the announced proof of the Glivenko-Cantelli type result for the P-indexed empirical measure 

Lemma 21 Let W CU be a Vapnik-C'ervonenkis class of measurable subsets ofU. Then, for any regular 
Borel subset, B, of [0, 1] , we have that 



where v n B is defined m0 



P lim sup \v n , B {W)-v{W)\=Q =1, 
\n-*+oo v^eVV 



Proof. The proof follows closely the lines of the arguments presented in Pollard [1984] , Section II. 3, 
pages 13-16. Almost sure convergence follows by Borel-Cantelli Lemma, once we show that, for all e > 0, 



V P f sup \v n . B (W) -u(W)\>e) < +oo. 
Define the sequence of natural numbers (&n) >i by 



(22) 



k? — card { B D I — , 



n n — 1 



so that the P-empirical measure can be written 



Vn ' B = W 5x >- 
n ieBn{±..,i} 

As in Pollard [1984] , it is possible to show that for all n > 1 such that k B > 8e~ 



P sup \v nB (W)-u(W)\>e) < 4P 



sup 



; 6 Bn{±...,l} 



> 



£p 



A 



/ 



where (<7 n ) n>1 is a sequence of Rademacher random variables independent of the sequence (X n ) n>1 . Now 
we deal with the conditional probability 



P 



sup 



\ 



i6Bn{i,...,i} 



> 



b 



X = Xi : - € P 



n 



Since W is a V.C.C., once the Xj's are fixed, there exist sets W\, ...,W k b, where coincides with the 
fc„ -th shatter coefficient of W, not depending on the finite family {x^ : - £ P| such that 



P 



sup 



iesn{i...,i} 



> 



B 



max 

l<j<K n 



Xi = Xi : - G P 
n 



ieBn{i,...,i} 



> 



Sky 



Xi = xt:-eB 
n 



> 

) 
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Again, as in Pollard [1984] , apply the union bound followed by Hoeffding inequality then integrate out 
to obtain that, for all n > 1 such that > 8e~ 2 , 



P ( sup Kb (W)-u(W)\> e) < 8K* exp ' 



32 



(23) 



Since W is a V.C.C., then K* < {kg + l) 5(W) , where S (W) is the V.C. dimension of W. Combining 
([22]) and (|23j) . it is enough to show that 



n>l 



e 2 k 



32 



< +oo. 



(24) 



Given B is a regular Borel set, then, by ©, lim r , 
< 7 < A (B) such that 



A (B) , so that, for sufficiently large n, there exists 



n{\{B)- 1 )<k%<n{\{B)+ 1 ) 



It follows that 

B , 



£ (tf + lf W) exp (-^) < ^ (n (A (5) + 7) + lf m exp 

n>l ^ ' n>l 



n (A (5) - 7) e 2 



32 / ~ 4-f V 32 

since A (B) — 7 > 0. ■ 

We are now ready to prove Theorem To prove (|10p . it is enough to show that, for all b > 0, 

VP sup A n (B) sup |i/ n ,B (W) - v (W)\ > b) <+oo. 
As before, we need to find a suitable bound for 



< +00, 



(25) 



P sup A n (5) sup K )B (WO - 1/ (W)| > 6 

( 



P 



sup — sup 



4 E w - " <w) 



ieBn{i,...,i} 



> 6 



Let jT n be the class of all subsets of 1} . Write 

n 

3n \_J *J n 1 



k=0 



where J* = 3 = 1) •••> (fc) } ' ^ = ^' •••> n ' ^ s ^ ne c ^ ass °f an subsets of l} of cardinality exactly 

equal to fc. Define 

J n (B#)±{Bn{±...,l}:BeB#y 

Since B# is a V.C.C., card{J n (B#)) < m B # (n) , where m B # (n) is the n-th shatter coefficient of B#. 
Finally, define 

J*(B # )±j*nj n (B # ), 
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and let 



K n*K ~ card 



[j£ (*#)) • 

Clearly, 

n 
fc=0 

It follows that 



P 



sup — sup 



i E w - v w 

i6fln{i,...,l} 



> 6 



< P ( max — max sup \vj (W) — v (W)\ > b J , 



where vj = card ^ X^gjn-f- 1} w ith the convention that vj = if J = 0. Then, 

P ( max — max sup (W) — f (W)| > b ] = P ( max max sup \vj (W) — v (W)\ > ^ 
\0<k<n n j e j"fe(B # ) w&W J \l<k<n JeJk(]B#) VKeW fc 

Now, 

/ 5 n \ 
P max max sup \vj (W) — u(W)\ > — 
\ i<k<n j<zj*(b#) WeW k J 



< 



E E p ( su p hw-"Wi>i) 



< V<# max pfsup > ^ 

n ( bn\ 

< *y m B # (n)P [ sup \v k (W)-v(W)\> — ) , 



where Uf. = k 1 Yli=i > an d where the last inequality follows from independence and identity in distri- 
bution of the XiS. Now, apply (|23p for P = [0, 1] to obtain 

P (sup^ K (W) - v (W)\ > ^\ < 8m w (fc) exp (-^) , 



where m (k) is the fc-th shatter coefficient of W. Consequently, 



P [ max max sup \vj (W) — v (W)\ > — ) < mP* (n) m w (A;) exp ( - 



fr 2 n 2 
32A; 



To show (|25p . it is therefore enough to show that 



11 / 7,2 2 \ / z.2 2 \ 

E E ™ % w ™ w ex p = E mW (*) E m% (») ex p ( < +0 °- (26) 

n>lfc=l ^ ' k>l n>k ^ ' 
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Since n > k, we have exp ^— ^k^j < exp ^— . Moreover, for all n > > max {S (B#) , S (W)} , 

where 5 and 5 (W) denote the V.C. dimensions of B# and W, respectively, we have that (k) < 

(k+lf m < M{W)k s ^ and that m B # (n) < (n + l) 5 ^*) < M(B # )n S ( B *), M (W) and M (%) 
being constants depending only on classes W and respectively. The convergence of the double series 
in the RHS of follows if it holds that, for all c> 0, 



^ £ n 5 ( B #) exp (-cn) < +oo, 

fe>l ra>fc 

which is, in turn, true if for all c > and all D±, D 2 £ N + , 

roo /"+oo 



/OO Z'+OO 
y y Dl x D2 exp (-ex) dxdy < +oo. 



Elementary calculus gives 

r -{p+l+2) 

(D 2 -p)\{D 1 + D 2 -p-l)\ 



nco^^z E C ^ 7 _«^±^L_ < ^, (27) 

p=0 «=0 

completing the proof of (fTUj) . As for (O, just observe that 
sup sup |P„ (B x W) - A (5) i/ (W)| < sup A n (B) sup |i/ n>B (W) -v{W)\+ sup |A„ (5) - A (B)\ . 

B&B # W&W s 6% VKeW BeB # 

The first term of the RHS converges almost surely to thanks to (|27p so that the deterministic convergence 
to described in (fTTj) implies (JEJ. 



4.3 Functional central limit theorems 

Let Q C ^\i°' 1 ] xU be a class of 0([0, 1] <S> £/)-measurable functions defined by conditions (a) and (b) of 
Section [21 Let (X n ) n>1 be a sequence of i.i.d. random variables of law v defined on a probability space 
(Q,A, P) and taking values in some measurable space (U,U) . As already announced in that Section, will 
will prove convergence of finite dimensional laws of the sequence of Q- indexed processes {Z n (q) : q £ Q} , 
n > 1, where 

Zn (q) = y/n (Pn (?) " (An ® f) (?)) , 

A n being the discrete uniform measure and P n (q) being defined in (P), to those of the Q-indexed centered 
Gaussian process {Z (q) : q G Q} whose covariance structure is given by (fl3j) . To begin with, we will prove 

r 

that, for all q € Q, Z n (q) — > Z (g) .We first need to make some remarks and introduce some notation. 
Note that if q £ Q then q £ Q where q is defined, for all (s, x) £ [0, 1] x U, by 

q(s,x) = q(s,x) - u(q)(s) . (28) 

Now, use the sequence (X n ) n>1 to construct the triangular array (Xi n ) 1<i<nn>1 of independent random 
variables as follows: 

A q(i/n,Xj) 

-A-in — / — j 

where q is defined in (|28p . Note that 

n 

(?) = 

i=l 

and that 

Z(q)±N(0,(\®v) {?)). 
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Lemma 22 For all q G Q, Z n (g) -4 Z (q) . 

Proof. We first treat the case when (A (g> v) (g 2 ) = 0. In this case, Z (q) = 6q. Moreover, it is easily seen 
that E [{Z n (g)) 2 ^ = (A n (8> v) (g 2 ) ,so that, by (HU), Z n (g) — > Z (g) ,and consequently Z ra (g) <5o- In the 

case in which (A (8) z/) (g 2 ) > 0, Lindeberg central limit theorem implies that Z n (g) — > Z (g) if 

1 n /" 

Ve>0, lim — rr-^ V/ <f (i/n, v (dx) = 0. (29) 

n (A n <8> V) {q 2 } j{x:\q{i/n,X i )\>ey/n(X n ®u)(ip)} 

By condition (a) in sectional by (|14p and by the fact that, for all e > 0, 

jx : |g(i/n,J£i)| > ey/n{\ n ® z^) (g 2 )} C jx : |#g(x)| > ey/nJXn (8> i>) (g 2 )} , 
for sufficiently large n, there exists < 7 < (A (g) z/) (g 2 ) such that, for all e > 0, 



z; 



7T - 1 E /r , 1 f X,) „ (dx) 

(A n <8> V) [q ) ^ y{a ! :|g(i/n,Jf i )|>eV»(An®i')(g 2 )} 



— 71 \ / <?1 (x) f (dx) 

(A (8) V) (q Z ) J {x:\ 9ii (x)\>eyjn{\ n ®v)(e)} 

Since g^ 6 L2 (f) , 



n— >+oo 



lim / 5= (x) f (dx) = 0, 



|x:|gq(x)|>e^/n(A n (gii/)(g 2 )| 



which implies ((29 



To complete the proof of Proposition [91 we will employ the Cramer- Wold device. Fix a natural number 
1 < K < +00 and functions gi, ■ ■■,gK S Q. Consider the random vector Z n x = (Z n (gi) , Z ra (gj<-)) . To 
show that the sequence {Z n K) n>l converges in law to the vector Z n x = [Z (gi) , Z (gic)) , it is enough 
to show that the sequence of random vectors Z n x = (Z n (g~i ),..., Z (qx)), n > 1, converges in law to the 
random vector Z n K = (Z (gi) , Z (qx)) ■ This is equivalent to showing that, for all (01, ax) S 9t , 

K K 
/l aiZ n (qi) -» ajZ (gj) . 
i=l i=l 

It is easily seen that 



/ K \ 
Oi^n (gi) = Z n I y~] 
i=l \i=l / 



and, since Q is a linear space, we have by Lemma [ 

Z n ai ^j ^ ^E 

Finally, it is easily seen that 



Var (^Z {^Z ai ^j J = Var aiZ = ( A ® ^) ( ^E 
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proving Proposition [9] 



Let's return back to JF^-indexed s.e.m.p.'s with G vr {yG 2 , J-VC) or J 7 ^ £ it (UB, M-VC) . To prove 
weak convergence in the former case, we will use the findings of section 4.2 in Ziegler [1997] . The following 
Theorem summarizes the results needed. 

Theorem 23 (Ziegler, 1997, Paragraph 4- 2) Let (T,£) be a measurable space and let (?7ra)x<i<i(n) n>i 
be a triangular array of rowwise independent T -valued random variables with laws v n i, respectively. Let 
J- be a class of £ -measurable real valued functions defined on T with envelope F and assume that J 7 has 
a uniformly integrable L^-entropy (see Ziegler [1997] for the definition of uniformly integrable L2-entropy 
of a class J 7 ). Assume also that there exists a metric d on T such that (J-,d) is a totally bounded metric 
space. Consider the T '-indexed stochastic processes {S n (/) : / G J 7 } , n > 1, where, for all n > 1, 

Sn (f)±—±= y (f(r)ni)-vm(f)), ftF. 
VH n ) 



l<i<i(n) 



define the probability measure 



1 X - 



i (n) 

l<i<*(n) 



and the quantity 



a n (a)= sup \\v n [(f-g) z ), a > 0. 

{f,g£F-Af,g)<a} 



^n((f-g) 2 ), 



If there exists a centered J- -indexed Gaussian process G = {G (/) : / G J 7 } such that the finite dimensional 
distributions of the sequence of processes S n converge to those of G and if 

(i) SWY> n >\ < (F 2 ) < +OO; 

(ii) lim^jo li m SU P a n (oi) = 0; 

ri— >+oo 



(Hi) for all 5 > 0, 



^oo E ^( i?2 ^)- 1 (^ + oo) (F(r?ra)) ) =0 ' 

l<i<i{n) v v ' 



then there exists a version G of G, with uniformly bounded and uniformly continuous sample paths 
such that 

S n G. 

sep 

Theorem [10] is a corollary of Theorem 1231 To see this, define the triangular array of rowwise independent 
random variables 

Vni = (i/n,Xi) , l<i<n,n<l, 

and observe that, for all 1 < i < n and all n > 1, the law of rj n i is S^/ n v. The sequence of stochas- 
tic processes {S n (/) : / G J 7 ^ described in the statement Theorem [23] is nothing but the sequence of 

(2) (2) 

stochastic processes {Z n (/) : / G T^} . Now, {T^, d), with d = d\ + d v is a totally bouded and since 
any G tt (uG 2 , J-VC) is by definition a V.C.G.C., then it posseses a uniformly integrable L2-entropy. 
As for convergence of finite dimensional laws, since J- n C Q, then the finite dimensional laws of the process 
Z n converge to those of Z. We are, therefore, only left with the verification of conditions (i), (ii) and (iii) 
of Theorem [23] Condition (i) is immediate since it translates as follows: 

sup (A n 8) v) (G 2 ) < +oo, 

n>l 
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and G £ L2 (v) . Moreover, condition (iii) applied to our case becomes 

1 n 

V * > °< n S E (° 2 W • 1 (^, + oo) (G (*))) = 0, 
i=l 

which is true by dominated convergence, since G G L2 (1/) . Finally, condition (ii) is exactly the conclusion 
of Proposition [201 

We end this section with the proof of Theorem [TTJ All the other conditions being true as for the case 
of J- n G 7r (vG 2 , J-VC) , we only need to prove d-equicontinuity of the sequence ^--indexed stochastic 
processes {Z n (/) : / G J 7 ^} , when T v G ir (UB, M-VC). As argued in Ziegler [1997] , it is enough to show 
that 



limlimsup E* sup 

a|0 rw+oo \{fij2e^:d(f u f 2 )<a} 



1 n 

7= Si [hi (i/n) gi (Xi) - h 2 (i/n) g 2 (Xi)] 
In 

i=l 



0. 



where E* denotes the outer expectation operator, where (£ n ) n >i is a canonically formed Rademacher 
sequence and where we have written f\ = h\g\ and f 2 = h 2 g 2 - For all J- n B f = hg, define the triangular 
array 

^ ni (f)^^h(i/n)g(Xi), 
Jn 



the random seminorm ||-|| such that, for all / G J- n , 



£ (/) 



i=i 



and the random pseudo-metric 



4 2 „ } (/l,/2) = l|/l-/2| 



With this notation, we need to prove that 



limlimsup E* sup 

<*|0 n ^+oo \,{/i,/26^:d(/i,/2)<a} 



£e* (A)-*™ (/ 2 )] 



1=1 



0. 



Note that 



CI®") (Zi'/a) = ll/i _ /2ll(A n ®^) - \j E (\\h ~ h 



(30) 



so that Theorem 3.1 in Ziegler [1997] yields the existence of universal constants Ki and K 2 such that 



E* sup 

V{/l,/ 2 e^:<i(/i,/ 2 )<a} 



i=i 



< (n, a) B (n) + i^ 2 C (n, a) 



with 



A (n, a) 



. E* [ max sup -= \hi (i/n) gi (Xi) - h 2 (i/n) g 2 (Xi)\ ■ l n (1) 



< ^LsjE* (ln(l)), 



B(n) = JE* (l n (l) 
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and 



In (a) 



C (n, a) = E (l n (a)) . 



logtf (r^dg^dr, a>0. 



Clearly, for all f% = h\g\ and fi = /i2<72 in all a; G SI and all n > 1, 

4 2 n ) (/i,/ 2 )<dg ) (5i,52)+4! l ) (^M 



where 



and 



92) 



1 " 

N -^( 5l (^)-52(X i )) 2 J 

\ i=l 



1 " 

\ - J^('»l( < / n ) -M*/ n )) 2 - 
\ i=l 



Rehearse the arguments of Proposition [19] to show that, for all w G fi, all r > and all n > 1, 

iV (r, ^, rig) < iV (r, W> 4 2 „ } ) iV (r, G, dgj 



It follows that, for all a > 0, all a; G and all n > 1, 



^° yiogiv( r ,^,4 2 n ))dT < yiogiv(r,W,4 2) )dr + f ^ 



Since, for all n > 1, A n is a finite measure on [0, 1] and since Ti is a V.C.G.C., then there exists a function 
7H ( r ) such that, for all n > 1, 



logiY(r,W,4 2) )dr < / 0og 7w (r)dr < + 



-oo. 



Analogously, there exists a function 70 (r) such that, for all n > 1 and all a; G O, 

jf yiogiv(r,g,^ 2) )dr < jf Vlog 7 g(r)dr<+oo. 



Consequently, 



which in turn implies that, for all a > 0, 



£7 Ul) < +°°, 



Moreover, since 



then 



lim sup A (n, a) i? (n) = 0. 

n— >+oo 



lim / (r)dr = lim / y^STS (r)dr = 0, 

"10 Jo aio J 



limlimsupC (n, a) = 0, 

aj.0 rw+oo 



completing the proof of (l30j) . 
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